Neural Network Labels

When a neural network is used for object localization, it can classify each localized object and give it a label. The label is an integer value that shows the category or class of the object (for example, the color of the object). You can see the labels in the Object Inspector, and your robot controller can receive them.

Contents

1 Viewing labels in the Object Inspector

The Object Inspector is available on the Deployment page when you inspect a localized object. It shows the properties of the localized object. When neural network classification is active, it also shows the label.

Note: If the neural network was not trained to assign labels, all objects show the same label value 0 (default).

Object label in the BPS visualizer

2 Receiving labels on the robot

Labels are automatically included in the data that is sent to the robot controller in the response to some action requests. Your robot program can read the label value and use it to handle each object class differently.

2.1 Requirements

Labels are sent to the robot only if the Robot module has the minimum required version:

  • Bin Picking Studio: Robot module version 1.12 or later

  • Locator Studio: Robot module version 1.5 or later

If your Robot module is older, the response does not include the label. Update the Robot module to receive labels.

2.2 Which requests include the label

The response to these action requests includes the label value:

  • Bin Picking Studio (AI Picking solution type)

    • Trajectory request

    • Object pose request

  • Locator Studio (AI Locator solution type)

    • Get objects request

2.3 What the robot receives

The label is a single integer value that is added to the response data for each localized object. The meaning of each value depends on the neural network model that was trained for your application. Contact your Photoneo technical consultant to get the mapping of labels to integer values.